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Abstract 

An  analysis  of  the  alpha-beta  pruning  algorithm  is  presented  which  takes  into 
account  both  shallow  and  deep  cut-offs.  A formula  is  first  developed  to  measure  the 
average  number  of  terminal  nodes  examined  by  the  algorithm  in  a uniform  tree  of  degree  n 
and  depth  d when  ties  are  allowed  among  the  bottom  positions:  specifically,  all  bottom 
values  are  assumed  to  be  independent  identically  distributed  random  variables  drav/n  from 
a discrete  probability  distribution.  A worst  case  analysis  over  all  possible  probability 
distributions  is  then  presented  by  considering  the  limiting  case  when  the  discrete 
probability  distribution  tends  to  a continuous  probability  distribution.  The  branching 
factor  of  the  alpha-beta  pruning  algorithm  is  shown  to  grow  with  n as  ©fn/ln  n),  therefore 
confirming  a claim  by  Knuth  and  Moore  that  deep  cut-offs  only  have  a second  order  effect 
on  the  behavior  of  the  algorithm. 
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1 - Introduction 


Most  so-called  Intelligent  programs  use  some  form  of  tree  searching;  among  them, 
most  game  playing  programs  are  built  around  an  efficient  tree  searching  algorithm  known 
as  the  alpha-beta  pruning  algorithm.  This  paper  Investigates  the  efficiency  of  this 
algorithm  with  respect  to  a cost  measure  first  introduced  by  Knuth  and  Moore  in  [3]  and 
given  in  the  following. 

Definition  l.l: 

Let  be  the  number  of  terminal  positions  examined  by  some  algorithm  A in 

searching  a uniform  tree  of  degree  n and  depth  d.  The  quantity 

is  called  the  branching  factor  corresponding  to  the  search  algorithm  A.  ■ 

Similar  analyses  have  been  attempted  In  two  recent  papers  by  Fuller,  Gaschnlg  and 
Gillogly  [1]  and  by  Knuth  and  Moore  [3],  Both  papers  address  the  problem  of  searching  a 
uniform  game  tree  of  degree  n and  depth  d with  the  a-fi  pruning  algorithm  under  the 
assumptions  that  the  n^  static  values  assigned  to  the  terminal  nodes  are  independent 
identically  distributed  random  variables  and  that  they  are  all  distinct.  We  Immediately 
observe  that.  In  order  to  evaluate  the  branching  factor,  the  last  assumption  requires  that 
the  distinct  values  assigned  to  the  terminal  positions  be  taken  from  an  Infinite  range. 
For  most  practical  applications  this  Is,  however,  unrealistic. 

Fuller,  Gaschnlg  and  Gillogly  developed  In  [1]  a general  formula  for  the  average 
number  of  terminal  positions  examined  by  the  oi-fi  procedure.  Their  formula,  however,  is 
computationally  Intractable  and  leads  to  undesirable  rounding  errors  for  large  trees  (i.  e., 
for  large  n and  d)  since  It  Involves,  In  particular,  a 2d-2  nested  summation  of  terms  with 
alternating  signs  and  requires  on  the  order  of  n'^  steps  for  Its  evaluation.  Then  they  gave 
some  empirical  results  based  on  a series  of  simulations,  and  compared  the  results  with 
actual  measurements  obtained  by  running  a modified  version  of  the  Technology  Chess 


Program  [2]. 
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In  [3],  Knulh  and  Moore  have  analyzed,  under  the  same  conditions,  a simpler  version 
of  the  fult  CV-/3  pruning  algorithm  by  not  considering  the  possibility  of  deep  cut-offs;  they 
have  shown,  in  particular,  that  the  branching  factor  of  the  resulting  algorithm  is  ©Cn/ln  n). 
Knuth  and  Moore  also  considered  other  assumptions  to  account  for  dependencies  among  the 
static  values  assigned  to  the  terminal  positions  and  developed  analytic  results  under  those 
assumptions.  Their  paper  gives,  in  addition,  an  excellent  presentation  and  historicat 
account  of  the  cX'/S  pruning  algorithm. 

Departing  from  the  assumptions  of  the  two  papers  we  just  mentioned,  we  first 
consider  the  effect  of  possible  equalities  between  the  values  assigned  to  the  terminal 
nodes  of  a uniform  tree,  assuming  that  these  values  are  independent  identically  distributed 
random  variables  drawn  from  any  discrete  probability  distribution.  In  Section  2,  we 
establish  some  notations  and  preliminary  results,  and  in  Section  3,  we  derive  a general 
formula  for  the  number  of  terminal  nodes  examined  by  the  a!-fi  pruning  algorithm  when  we 
take  into  account  both  shallow  and  deep  cut-offs.  The  evaluation  of  this  formula  requires 
Only  a finite  summation  over  the  range  of  possible  values  assigned  to  the  terminal  nodes 
and  is  relatively  easy.  We  show,  in  particular,  that,  when  the  terminal  nodes  can  only  take 
on  two  distinct  values,  the  branching  factor  of  the  cx-/3  pruning  algorithm  can  grow  with  n 
as  0(n/Xn  n.)  for  some  choice  of  the  probability  distribution.  In  Section  4,  we  show  that, 
when  the  discrete  probability  olstribution  tends  to  a continuous  probability  distribution, 
the  summation  derived  in  Section  3 can  be  replaced  by  an  integral,  which  constitutes  the 
worst  case  over  all  discrete  probability  distributions.  In  Section  5,  an  analysis  of  this 
integral  shows  that  the  branching  factor  of  the  a-fi  pruning  algorithm  for  a uniform  tree  of 
degree  a grows  with  n as  Gfn/ln  n),  therefore  confirming  a claim  by  Knuth  and  Moore  [3] 
that  deep  cut-offs  only  have  a second  order  effect  on  the  average  behavior  of  the 
a-/3  pruning  algorithm.  Some  concluding  remarks  and  open  problems  are  given  in  the  last 


section. 
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Presentation  and  Initial  properties  of  the  pruning  algorithm 


There  are  two  usual  approaches  for  dealing  with  searching  a game  tree.  In  [1], 
Fuller,  Gaschnlg  and  GiUogly  adopted  the  Mlix-Mclx  approach,  while,  in  [3],  Knuth  and 
Moore  chose  the  Nega-hfdx  approach.  We  will  briefly  present,  in  Section  2.1,  the  two 
approaches  and  introduce  the  u-fi  procedure  in  terms  of  the  Mega-Max  model.  Then,  in 
Section  2.2,  we  will  reestablish  an  initial  result  of  [1]  which  was  staled  in  terms  of  the 
Min-Max  approach. 

2.1  - The  oC-/5  procedure 

Let  us  consider  a game  (like  chess,  checkers,  lic-tac-toe  or  kalah)  played  by  two 
players  who  take  turns.  It  is  common  to  represent  the  evolution  of  the  game  by  means  of 
a game  tree,  where  each  position  of  the  game  is  represented  by  a node.  ]f  the  position  is 
a dead-end,  the  node  is  terminal,  otherwise  all  possible  moves  from  that  position  are 
represented  as  the  successors  of  the  node.  The  structure  of  the  tree  is  preserved  by  not 
generating  moves  leading  to  some  positions  already  generated  (thus,  avoiding  cycles);  this 
is  the  function  of  the  move  generator  The  evalaation  function  is  another  important 
function  in  game  playing  programs;  it  assigns  to  each  terminal  position  a static  value  by 
estimating  various  parameters  such  as  piece  counts,  occuoaticn  of  the  board,  etc.  The 
evaluation  function  evaluates  the  terminal  nodes  from  one  player’s  viewpoint,  giving 
higher  values  to  positions  more  favorable  to  this  player.  It  is  convenient  at  this  point  to 
name  the  two  players  Max  and  Min.  Hence,  Max's  strategy  is  to  lead  the  game  towards 
positions  with  higher  values,  while  Min’s  strategy  is  to  lead  the  game  towards  positions 
with  lower  values. 

The  minimax  procedure  is  directly  based  on  this  formulation  and  can  be  used  by 
either  Max  or  Min  to  decide  on  his  next  move  from  a given  position,  assuming  that  his 
opponent  will  respond  with  his  best  move.  Using  a rather  brute  force  approach,  the 
minimax  procedure  assigns  values  to  all  nodes  of  a game  tree.  It  first  assigns  to  terminal 
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nodes  the  results  of  the  evaluotlon  function,  then  it  backs-up  to  internal  nodes 
corresponding  to  a p.  tion  from  which  it  is  Max  s (Mins)  turn  to  play  the  maximum 
(minimum)  of  the  values  assigned  to  its  successors. 

Suppose  it  is  Max’s  turn  to  play  from  an  initial  position  (corresponding  to  the  root 
of  the  game  tree),  then  it  is  his  turn  to  play  from  any  positions  at  even  depth  and  Mm's 
turn  to  ptay  from  any  positions  at  odd  depth.  Therefore,  the  minimax  procedure  will 
back-up  values  to  the  nodes  of  the  game  tree  through  a succession  of 
Minimazing/Maxlmazing  ooerations.  This  corresponds  to  the  Min-Ma-x  approach. 

By  observing  that: 

max{  min{  xj,  ^2,  - }.  min{  yj,  >2'  - }•  - 5 ^ 

maxj  -maxj  -Xj,  - )>  -m.ax{  -y j,  -yp,  ),  ...  } , 
the  Min-Max  approach  can  be  directly  leformulated  into  the  N'ega-Mar  approach.  In  the 
Nega-Max  formulation,  a lermin.al  node  of  a game  tree  should  be  assigned  the  result  of  the 
evaluation  function  only  if  it  is  at  an  even  depth  (assuming  it  is  initially  Max’s  turn  to 
play)  and  it  should  be  assigned  the  opposite  of  the  result  of  the  evaluation  function  if  it  is 
at  an  odd  depth.  The  \'ega-Max  approach  requires  the  same  operator  at  all  levels  of  a 
game  tree,  and  the  uniformity  of  the  notation  will  make  it  easier  to  carry  out  a.n  analysis. 
This  approach  will  be  used  throughout. 


Figure  2.1  - Searching  a game  tree  with  the  minimax  procedure 


Figure  2.1  shows  the  effect  of  the  mlnimax  procedure  in  a uniform  tree  of  degree  2 
and  depth  4.  The  values  assigned  to  the  terminal  nodes  have  been  chosen  arbitrarily.  The 
path  indicated  by  a darker  line  shows  Ihe  sequence  of  moves  selected  by  the  procedure. 


The  minimax  procedure  is  clearly  a brute  force  search  and,  when  exploring  a node, 
it  uses  none  of  the  information  already  available  from  the  nodes  previously  explored. 
Obviously,  by  taking  advantage  of  the  information  previously  acquired  we  can  easily 
improve  on  the  brute  force  search.  Figure  2.2  presents  some  simple  patlerns  in  which  the 
distribution  of  the  information  could  lead  to  such  improvements. 


(b)  deep  cut-off 


Figure  2.2  - Examples  of  possible  cut-offs 

The  circled  nodes  have  already  been  exolored,  and  they  are  labeled  with  their  backed-up 

values;  the  values  of  the  other  nodes  are  yet  to  be  determined.  We  are  interested  in  the 

value  V of  the  top  level  node  in  both  patterns  (a)  and  (b). 

Let  us  consider  the  pattern  of  Figure  2.2  (a)  first.  From  the  definition  of  the 
minimax  procedure,  the  values  v and  x satisfy: 

V « max{  3,  -z  ] , x • max{  -2,  ...  } , 

which  shows  that  * s -2  or  2 i -z.  Since  3 i 2 i -r,  it  follows  that  independent  of  the 

exact  value  of  x,  we  will  have  v - 3.  This  shows  that  we  need  not  explore  further  the 
successors  of  the  node  labeled  x if  we  are  only  interested  in  the  value  of  v.  This  leads  to 
a first  type  of  cut-offs  known  as  shallow  cut-offs. 
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The  pattern  of  Figure  2.2  (b)  illustrates  a deeper  cut-off.  As  with  the  previous 
example,  there  are  immediate  relations  between  the  values  of  the  nodes.  In  particular,  we 
have  y i -z,  which  leads  us  to  consider  two  cases.  Either  y > -z,  and  this  means  that  the 
value  y is  determined  by  its  right  son(s)  and  certainly  does  not  depend  on  the  right  son{s) 
of  z.  Or  y = -z,  in  which  case,  since  r s -y  and  z i -2,  we  deduce  x ^ -2  or  -z  s 2;  but 
since  1/  » max{3,  -x}  it  follows  that  i/  = 3,  independent  of  the  exact  value  of  z and,  a 
forliori,  independent  of  the  exact  value  of  z.  This  shows  that  in  either  case  the  successors 
of  the  node  labeled  z need  not  be  further  explored  since  the  final  value  of  i/  would  in  no 
way  be  affected. 


The  two  examoles  presented  in  Figure  2.2  indicate  that  a reduction  of  the  search 
can  be  achieved  if  a node  passes  down  to  its  sons  the  current  value  backed-up  so  far  (3  in 
the  case  of  the  two  above  examples)  as  a bound  for  pruning  branches  2,  -f,  6,  ...  levels 
below;  the  bound  can,  of  course,  be  improved  as  the  search  progresses  down  the  tree 
(leading  to  more  and  more  possible  cut-offs). 


Using  two  bounds  for  even  and  odd  levels  of  a tree,  these  improvements  are 
implemented  in  the  following  procedure  adaoted  from  [3]. 

integer  procedure  ALPHABETAf position  P,  integer  alpha,  integer  beta): 
begin  integer  y.  f,  n; 

determine  the  successor  positions;  P ,,  ...,  P ; 
ii  ri  = 0 tjTen 

ALPHABETA  ;=  /TP) 

else 

begin 

for  j 1 step  I until  n dp 
begin 

t ;=  -ALPHABETA(P^,-beta, -alpha); 

U f > alpha  then  alpha  ;»  t; 

if  alpha  a beta  then  goto  done  (2.1) 

end; 

done:  ALPHABETA  .-=  alpha 

end 

end 


The  alpha-beta  procedure  (from  [3]) 
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The  function  denoted  by  / Is  the  evaluation  function  which  assigns  static  values  to  terminal 
positions. 

Knuth  and  Moore  [3J  have  shown  this  procedure  to  be  correct  In  the  sense  that  the 
call  ALPHABETA(P,-co,*<x))  assigns  to  position  P the  value  MINIMAXIP),  which  Is  the  value 
assigned  by  the  mlnlmax  procedure.  More  generally,  they  showed  [3,  p.  297]  that; 


ALPHABETAfP, alpha, beta)  s alpha. 

If 

MINIMAX(P)  s alpha. 

(2.2) 

ALPHABETA(P,alpha,beta)  - MINIMAX(P), 

If 

alpha  < MINIMAX(P)  < beta. 

(2.3) 

ALPHABETA(P,alpha,beta)  i beta. 

If 

MMMAX(P)  i beta. 

(2.4) 

The  same  tree  used  In  Figure  2.1  to  Illustrate  the  mlnlmax  procedure  Is  shown  In 
Figure  2.3  to  Illustrate  the  effects  of  the  a-/3  procedure. 
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Figure  2.3  - Searching  a game  tree  with  the  a-/3  procedure 

The  branches  pruned  by  the  procedure  are  Indicated  with  dashed  lines,  and  the  nodes 
marked  with  a circle  have  not  been  completely  explored.  We  observe  that  only  8 out  of 
the  16  terminal  positions  and  19  out  of  all  the  3i  nodes  are  examined  by  the  ex-/?  pruning 
algorithm  in  this  example,  reducing  greatly  the  cost  of  searching  the  tree.  As  Is  seen  by 
comparing  Figures  2.1  and  2.3,  the  values  backed-up  by  the  cx-/5  procedure  to  some 
Internal  nodes  are  not  necessarily  the  same  as  the  values  backed-up  by  the  mlnlmax 
procedure,  as  reflected  by  the  Indeterminatlon  in  equations  (2.2)  and  (2.4).  The  top  value, 
however,  is  not  affected  by  this  Indeterminatlon. 
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2.2  - Somo  properties  of  the  u-fl  pruning  algorithm 

In  this  section,  we  will  introduce  some  notations  which  will  be  used  throughout,  and 
we  will  reestablish,  in  terms  of  the  Nega-Max  approach,  an  initial  result  of  [1]  giving  a 
necessary  and  sufficient  condition  for  any  node  of  a game  tree  to  be  examined  by  the 
CX-/S  pruning  algorithm. 

2.2.1  - Notations 

As  in  [3],  we  will  use  the  Dewey  decimal  notation  to  represent  a node  in  a tree. 
More  precisely,  let  c,  the  empty  sequence,  denote  the  root  of  the  game  tree.  Then,  if  ^ 
denotes  some  internal  node  of  the  tree  with  n sons,  ^.j  will  denote  the  ;-th  son  of  node 

for  j = 1 n.  In  Figure  2.4,  node  4.1.3.43  is  the  node  at  depth  5 whose  path  from  the 

root  is  indicated  with  a darker  line. 

cd)  - 2 

= -00 

cM.l.s;  - 3 

014. 1.3. 4;  - -S 

c(A.l.3.4.3>  » 0 

01(4.1.3.4.3)  = max{  c(4.l.3.4.3),  c(4.1.3),  c(4)  } - 3 
fi(4.1.3.4.3)  = 'max[  c(4.1.3.4),  c(4.1)  } » 5 

Figure  2.4  - Portion  of  a game  tree  showing  the  path  to  node  <4.1.3.4.3> 

The  value  associated  with  some  node  ^ of  a game  tree  by  the  minimax  procedure 
(see  Section  2.1)  will  be  denoted  by  t/f^).  Then,  if  ^ is  a terminal  node,  uCp)  is  the  static 
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value  asigned  to  that  terminal  position,  and,  if  ^ is  an  internal  node,  v(^)  is  the  value 
backed-up  to  node  J by  the  minimax  procedure.  In  the  latter  case,  if  node  has  n sons, 
v(^}  Is  given  by; 

v(^)  « max{  -v(^.j)  \ 1 i j i n } . (2.5) 

In  Figure  2.4,  the  nodes  on  the  path  from  the  root  to  node  4.1.3.4.3  are  evaluated  through 
formula  (2.5)  while  the  other  nodes  (including  4. 1.3.4. 3)  are  shown  as  terminal  nodes  and 
are  assigned  arbitrary  values.  (Nodes  are  labeled  with  their  values.) 

While  the  values  v(J)  deal  with  the  static  aspect  of  a game  tree,  the  quantities  we 
will  introduce  next  deal  more  with  the  dynamic  aspect  of  the  tree  when  being  searched  by 
the  £X-/5  procedure. 

For  any  node  p.j  at  depth  d i I,  we  define: 
c(J.j)  - max{  -v(^.i)  I I s i s j-I  } . 

(By  convention,  the  maximum  over  an  empty  set  is  defined  to  be  -oo;  in  particular, 
c(p.l)  - -03.)  For  the  root  of  the  tree  we  also  define  c(c)  = -co.  The  quantity  c(J-)  accounts 
for  the  information  provided  to  node  ^ by  its  elder  brothers.  These  values  are  indicated 
to  the  right  of  the  game  tree  shown  in  Figure  2.4  for  all  nodes  on  the  path  to  node 
4.1.3.4.3i  only  the  nodes  indicated  with  squares  are  used  in  computing  these  values. 

We  finally  define  lor  any  node  } = j ^ at  depth  d i f in  a game  tree  two 

quantities  directly  associated  with  node  } by  the  oi-fi  procedure.  For  i « C d-/,  let 

- Ji Id-i-  define: 

ai(J)  « m3x[  c(^J  I i is  even.,  0 s t s d-1  ] , 

/3<^)  - -max  I c(^^)  | I is  odd,  Oils,  d-1  } . 

It  is  convenient  to  define  these  two  quantities  for  the  root  of  the  game  tree  by  ale)  - -03 
and  fiU)  - *03  (which  is  consistent  with  the  definition).  These  a-  and  /3-values  are  shown 
in  Figure  2.4  for  the  node  4.1.3.4.3  along  with  their  definitions. 
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2 2.2  - Necessary  and  sufficient  condition  for  a node  to  be  explored  by  the  oC-,3  procedure 

The  following  lemma  justifies  the  notations  we  just  Introduced  In  the  preceding 
section. 

Lemma  2.1 : 

Assume  that,  initially,  the  root  of  a game  tree  Is  explored  by  the  oi-fi  procedure 
through  the  call 

ALPHABETA(root,-oo,*a))  . (2.6) 

Then,  If  node  ^ Is  examined.  It  Is  through  a call  of  procedure  ALPHABETA  In  which  the 
parameters  alpha  and  beta  satisfy: 

alpha  = oi(^)  , (2.7) 

beta  = li(J-)  . (2.8) 

Proof: 

If  = y'j denotes  some  node  explored  by  the  procedure  at  depth  d i.  1,  let,  as 

before,  for  0 s t sd-1.  Thus  node  J- j Is  the  father  of  node  J,  while.  If 

i 2,  node  Is  the  brother  of  ^ immediately  preceding  (and  explored  just 

before  ^).  Observe  that,  if  = 1,  c(^q}  = c{^)  » -od  and  therefore: 
m max{  1 1 Is  euen,  0 s : s d-I  } 

» - [ -max[  I ‘ i-S  odd,  0 s t s d-2  ) ] 

- 

(similarly,  /S(^}  = -ar('^j)).  Observe  also  that.  If  i 2: 
oi(^)  » max{  oi(^2^  • ) 

. max{  . c[i?i  . -‘'(^/•Oji-1^]  } 

and  that  fi(^)  » 

By  the  call  of  line  (2.6),  relations  (2.7)  and  (2.8)  certainly  hold  for  the  root  of  the 
game  tree,  since  cxCc)  » -oo  and  /l(t)  - ♦«.  Then  the  proo.  follows  by  Induction  from 
inspection  of  the  procedure  ALPHABETA,  and  from  the  relations  we  derived  above.  ■ 
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The  following  theorem  states  a useful  relation  that  characterizes  the  fact  that  a 
node  of  a tree  Is  explored  by  the  a-/3  pruning  algorithm.  This  relation  was  first 
established  by  Fuller,  Gaschnlg  and  Glllogly  [1]  with  different  notations  In  terms  of  the 
Mi.n-Max  model. 

Theorem  2.1 : 

Assume  that,  Initially,  the  root  of  a game  tree  Is  explored  by  the  a-/3  procedure 
through  the  call 

ALPHABETA(root,-co,*oo)  . 

Then,  an  arbitrary  node  ^ of  the  game  tree  will  be  subsequently  explored  If  and  only 
If 

< m)  ■ (2.9) 

Proof: 

Because  of  the  presence  of  line  (2.1)  In  procedure  the  ALPHABETA,  the  result 
follows  directly  from  the  result  of  Lemma  2.1.  ■ 

Since  It  will  be  more  convenient  In  the  following  secllons,  rather  than  uQ)  and 
we  will  use  the  quantities; 

= max{  cia'i)  I ‘ ei/en,  0 <i  i ^ d-1  } , 

B(^)  = max{  c(J-)  | t Is  odd,  Oi.  is.d-l  ) . 

where  Is  defined  as  before.  The  definitions  of  and  Ei^)  are  more  symrretrlcal,  and 
relation  (2.9)  can  also  be  rewritten  In  a more  symmetrical  way: 

P^i3-)  * BQ)  < 0 . (2.10) 

3 - Number  of  nodes  explored  by  the  od-/?  procedure:  discrete  case 

As  In  [1]  and  [3],  we  will  evaluate  In  this  and  the  following  section  the  amount  of 
work  performed  In  searching  a random  uniform  game  tree  using  the  ct-fi  pruning  algorithm. 
The  definition  and  some  properties  of  random  unlforfji  game  trees  are  given  In  Section  3.1. 
The  amount  of  work  performed  by  the  (x-/3  procedure  Is  measured  by  the  number  of 
terminal  nodes  examined  during  the  search  and  Is  evaluated  In  Section  3.2. 
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3.1  ■ Random  uniform  gamo  trees 

In  order  to  perform  an  analysis  of  the  pruning  algorithm,  we  will  limit 
ourselves  and  consloer  the  following  class  of  game  trees. 

Definition  3.1 : 

A game  tree  In  which 

(a)  all  Internal  nodes  have  exactly  n sons,  and 

(b)  all  terminal  nodes  (or  bottom,  positions)  are  at  depth  d 
Is  called  a uniform  game  tree  of  degree  n and  depth  d. 

A uniform  game  tree  which  satisfies  the  additional  condition 

(c)  the  values  assigned  to  all  terminal  nodes  (or  bottom  values)  are  Independent 
Identically  distributed  random  variables 

Is  called  a random  uniform  game  tree,  or,  for  short,  a rug  tree.  M 

Unless  otherwise  specified,  we  will  only  consider  throughout  a rug  tree  of  degree  n 
and  depth  d. 

Since  the  value  backed-up  to  a node  by  the  minlmax  procedure  only  depends  on  the 
backed-up  values  of  Its  sons,  we  Immediately  observe  that,  by  condition  (c),  the  backed-up 
values  of  all  nodes  at  the  same  depth  are  also  Independent  Identically  distributed  random 
variables.  In  the  remainder  of  the  section,  we  will  assume  that  the  bottom  values  are 
drawn  from  the  finite  set  { k/m  | -m  s k sm  },  for  some  m a 0,  and  we  will  denote  by 
simply  {pjk}]  the  common  probability  distribution  lor  the  backed-up 
values  of  all  nodes  at  depth  d - i (1.  e.,  p^(k)  Is  the  probability  that  the  value,  v(^), 
backed-up  by  the  minlmax  pc'- - ’Jure  to  some  node  ^ at  depth  d-i  be  k/m).  In  particular, 
[pQ<k)]  Is  the  common  probab.utv  distribution  (or  all  bottom  values,  and  {p^(k)}  Is  the 
probability  distribution  for  the  value  backed-up  to  the  root  of  the  rug  tree. 


The  following  lemma  states  the  relations  between  these  probability  distributions. 
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Lemma  3.1 : 

For  i - 0,  d-1,  we  have: 

Plt.l(-m)  * ...  * - lp^(-k)  * ...  * p^(m.)]^  . (3.1) 

Proof: 

Let  be  some  Internal  node  at  depth  d-i-t,  then  by  equation  (2.5),  v(p)  i k ii  and 

only  If  -v(^.J)  s k,  for  j = I,  ...,  n.  Equation  (3.1)  follows  easily  from  the  fact  that  all 

variables  v(J.J)  are  independent.  | 

Since  the  quantity  Pj(-k)  * ...  * p^(m)  wilt  occur  again  later  on,  we  define  for 
i - 0,  1,  ...  and  -m  k m: 

Pj(k)  = PjC-lc)  + ...  ♦ Pji'm)  . 

For  convenience,  we  also  define  p^(-m-V  = 0.  Note  that  p^(k)  is  a non-decreasing  function 

of  k which  satisfies  ^^(-m-1)  = 0 and  = p^(-m)  * ...  p^(m)  - 1.  By  rewriting 

equation  (3.1),  we  see  that  satisfies: 

" 1 - [Pii'c.’r  for  L ^ 0,  I,  ...  , (3.2) 

and,  therefore: 

f>l^2^k)  = I - [1  - lf>^(k)r]'^  for  i^O,  1 (3.3) 

The  following  quantities  will  also  be  useful  in  Section  3.2.  For  i - 0,  1,  ...  and 
-m-l  i k i m,  define: 

p/fc)  - 1 * [sP^ffc.']  * ...  * [p^(/c)f  ^ , (3.4) 

and 

o-^(k)  ~ I * [p-(-fc-l)]  * ...  ♦ . (3.5) 

Observe  that  p^(-nx-l)  - cr^C/n)  - 1 and  pj^m)  • <r^(-nx-l)  « n. 

Lemma  3.1  establishes  the  probability  distributions  for  all  the  values  in  the  nodes 


of  a rug  tree.  The  next  lemma  establishes  a similar  result  for  the  quantities  c(^)  defined 
In  Section  2. 
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Lemma  3.2: 

Let  ^.j  denote  any  node  at  depth  i,  where  i = I,  ....  d.  If  j - 1,  c(J.j)  - -co.  If 
J i 2,  then  the  probability  distribution  of  cQ.j),  denoted  by  satisfies: 

* ...  ♦ - [pjk)y-^  . (3.6) 

Proof: 

When  J « 1,  c(^.j)  - -oo  by  definition.  When  j i 2,  equation  (3.6)  follows  from  the 
same  argument  given  in  the  proof  of  Lemma  3.1.  | 

In  order  to  evaluate,  through  equation  (2.10),  the  probability  that  a terminal  node  is 
explored,  we  first  need  to  determine  the  probability  distributions  for  the  two  quantities 
A(^)  and  B<J).  This  is  done  in  the  following. 

Lemma  3.3: 

Let  ^ JiJq  denote  any  terminal  node. 

(1)  If  4 ' ^ ^or  all  even  integers  t in  the  range  0 i i i d-i,  then  A(J)  - -eo. 

(2)  Otherwise,  the  probability  distribution  for  A(^),  denoted  by 

satisfies: 

- TTe  lf>yk)]^‘-  ^ . (3.7) 

where  the  product  denoted  by  TT^  is  extended  to  all  even  integers  in  the  range 
0 a i i d-I. 

Similarly, 

(1 ')  If  - 1 for  all  odd  integers  t in  the  range  Isis  d-1,  then  BQ)  = -oo. 

(2')  Otherwise,  the  probability  distribution  for  BQ),  denoted  by  {t>k^J)].rnikim’ 

satisfies: 

‘ , (3.8) 

where  the  product  denoted  by  TT^  is  extended  to  all  odd  integers  in  tl  , range 
lain  d-1. 

Proof: 


We  will  only  consider  AQ)  since  the  proof  relative  to  B(^)  is  the  sa: 


art  (1) 
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follows  directly  from  the  definition.  For  part  (2),  let  denote  the  node  j^.  We 

note  that  A(^)  s fc  if  and  only  If  c(^^)  s k for  all  even  Integers  i in  the  range  0 i.  i i.  d-l 
such  that  i.  2.  Since  the  variables  are  Independent,  equation  (3.7)  follows  from 

equation  (3.6>  by  observing  that,  In  the  product  TTg,  a factor  corresponding  to  - 1 
amounts  to  1.  I 

The  last  lemma  in  this  section  states  the  probability  of  exploring  a terminal  node. 

Lemma  3.4: 

Let  (7  - ji-JQ  denote  any  terminal  node.  The  probability  r((^)  that  node 

^ is  examined  by  the  q;-/S  procedure  is  given  by; 

rr(^)  ml  if  m ! for  all  even  integers  i in  the  range  0 s t s d-J, 

ml  if  m 1 for  all  odd  integers  i in  the  range  1 i i.  i.  d-l, 

k(J)  m T * - * d.t-iCt?)]  otherwise.  (3.9) 

Proof: 

When  m I for  all  even  integers  i in  the  range  0 s i ^ d-l,  by  Lemma  3.3  A(^)  = -cd. 
Hence  A{J)  * B(J)  = -co  too,  and  by  Theorem  2.1  node  ^ is  certainly  explored.  Similarly 
when  m 1 for  all  odd  integers  in  the  range  I i i i,  d-l. 

Otherwise,  both  A(J)  and  are  finite.  Let  A(^)  m k.  We  observe  that 

A(^)  * B(^)  < 0 if  and  only  if  -m  ^ k i m-l  and  -m  s B(^)  s -k-1.  Hence,  equation  (3.9) 
follows  from  Theorem  2.1  and  the  fact  that  Af^)  and  B(^)  are  independent  variables.  I 

Using  equations  (3.7)  and  (3.8),  equation  (3.9)  can  be  rewritten  as: 
n(^)  . Z af^(^)  [9>,(-k-l)]^^'^  , 

m z , iip,(k)]^^'^  - n,  [^^(k-i)]^^'‘}  [pj-k-i}f^'^  (3.10) 

-mikim-l  e ‘ c i. 

(recall  that  ^J-m-l)  = 0). 
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3.2  - Number  of  terminal  nodes  examined  by  the  aL-/i  pruning  algorithm:  discrete  case 

We  are  now  able  to  evaluate  the  amount  ot  work  performed  by  the  procedure 
white  searching  a rug  tree.  As  in  [1]  and  [3],  we  have  chosen  to  measure  the  amount  ot 
work  by  the  number  ot  terminal  nodes  examined  by  the  procedure.  (We  will  also  consider 
briefly,  at  the  end  of  the  section,  the  total  number  ot  internal  and  terminal  nodes  explored 
by  the  procedure  as  a measure  of  performance.) 

Theorem  3.1 : 

The  average  number,  bottom  positions  examined  by  the 

ex-fi  procedure  in  searching  a rug  tree  of  degree  n and  depth  d,  for  which  the  bottom 
values  are  distributed  according  to  the  discrete  probability  distribution 
by: 

N^j(m)  - n.W^\  * -rrlk^nx  ‘ 

where  the  quantities  p^(k)  and  o-Jk)  are  defined  by  equations  (3.4)  and  (3.5),  and 
where  the  products  denoted  by  FT^  and  TT^  are  defined  in  Lemma  3.3. 

Proof: 

By  definition  of  the  probability  k(^),  the  average  number  of  bottom  positions 
examined  by  the  cx-fi  procedure  is 

. Z it(J)  , 

where  the  sum  is  extended  to  all  terminal  nodes  J and  is  actually  a 

d-nested  summation  over  the  range  I i.  Jq  s.  n,  1 i.  j ^ i n, ....  1 i.  s n.  The  summation 
can  be  rearranged  as: 

^ i>  . 

where  the  three  summations  Zg,  Z^  and  Z correspond  to  the  three  expressions  for  n(}) 

given  in  Lemma  3.4.  The  fourth  term  n(\ 1)  is  subtracted  from  the  sum  since  it  is 

counted  by  both  Zg  and  Z^.  These  two  sums  are  easily  evaluated  since  all  the  terms  ni^-) 
are  1.  As  ^rCl 1)  itself  is  1,  we  obtain: 

- / * Z }(<})  . 


(3.12) 
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It  IS  to  be  noted  that  the  first  three  terms  correspond  exactly  to  the  number  of  terminal 
nodes  examined  by  the  q;-/5  procedure  under  optimal  ordering  of  the  bottom  values 
(see  [5,  p.  201]). 

We  now  evaluate  the  sum  Z.  . Inside  the  sum  the  terms  n(^)  can  be  evaluated 
through  equation  (3.10).  We  note  that  all  the  summations  relative  to  j^,  for  t » 0,  /,  d-1, 
can  be  done  independently,  each  one  being  the  of  a geometric  series.  Using  the 
quantities  p^(k)  and  c-^(k)  defined  by  equations  (J  nbtain: 

Z = Z [TT  pj(k)  - n p.  ‘ ^ • 

The  theorem  follows  from  this  last  equation  and  equ,  dor  (o.l2),  using  the  facts  that 
p^(m)  = n and  that  o-^(m)  = f.  ■ 

The  formula  of  equation  (3.1 1)  can  be  easily  evaluated  and  provides  us  with  a 
measure  of  performance  for  the  cx-/5  pruning  algorithm.  For  some  applications,  however 
(especially  when  the  cost  of  generating  moves  is  greater  than  the  cost  of  evaluating 
positions),  i,t  is  more  convenient  to  use  the  total  number  of  nodes  (internal  and  terminal) 
explored  by  the  procedure  as  a measure  of  performance.  Let  denote  the  average 

o'  -.lis  number.  The  same  way  we  evaluated  we  can  evaluate  T^^(m)  by  summing 

the  probabilities  t((^)  over  all  nodes  of  the  tree.  We  obtain: 

where  is  the  average  number  of  nodes  examined  at  depth  i,  and  is  directly 

derived  from  the  expression  of  equation  (3.11)  by  replacing  d by  t and  {pQ(k)} 

by  {P({-^(k)]  (recall  that  {pQ(k)]  is  the  probability  distribution  for  the  values  assigned  to 
the  terminal  nodes  and  that  {p^.^(k)}  is  the  probability  distribution  for  the  values 
backed-up  to  nodes  at  depth  i). 

3.3  - Bi-valued  rug  frees 


I 


Although  it  is  relatively  easy  in  most  game  playing  programs  to  obtain  (by 
inspection  of  the  evaluation  function)  an  accurate  bound  for  the  range  of  distinct  values 


IS 


assigned  to  the  various  positions  of  the  game,  it  is  usually  not  so  easy  to  derive  a good 
estimate  for  the  probability  distribution  of  these  values.  In  the  remainder  of  the  section 
we  will  study  rug  trees  In  which  the  terminal  nodes  can  only  take  on  two  distinct  values, 
and  we  will  see,  in  particular,  that  a change  in  the  probability  distribution  of  these  values 
can  lead  to  very  important  differences  in  the  growth  rate  of 

We  will  assume  in  the  following  that  the  values  assigned  to  the  terminal  nodes  of  a 
rug  tree  can  only  be  either  -1  or  *1  with  respective  probabilities  l-p  and  p,  for  some 
p £ [0,  1],  Under  these  conditions,  the  number,  T^^(p),  of  terminal  nodes  examined  by  the 
(y-/3  procedure  can  be  obtained  as  a particular  case  of  equation  (3.11)  in  which  m - f and 

by  Pq(-U  - i-p,  Pq(0)  - 0,  pq(I)  - p. 


Theorem  3.2: 


Let  pq  m p,  and,  for  i » 1 let  pj  - 1 - p"y. 

with 


n 

-Pi’ 


P . n 

° } - Pi 


where  the  products  Tig  and  TJ^  are  defined  as  before. 


Proof: 


(3.13) 


Choose  m ■-  I and  define  the  probability  distribution  Po^~^^  “ ^~P’ 

Pq(0)  = 0 and  pq(I)  » p.  Hence  pq(-2)  « 0,  PQ(-i)  - pq(0)  - p - pq  and  pq(1)  - 1.  By 
equation  (3.2)  we  obtain: 

Pi(-2)  » 0 , pj(-l)  » p^CO)  - p^ , , for  i - 0,  . 

Then  equation  (3.13)  follows  directly  from  Theorem  3.1  and  equations  (3.4)  and  (3.5).  I 


Equation  (3.13)  can  be  evaluated  very  easily  and,  in  particular,  we  note  that  for 

0 < p < 1: 

"^n/P^  > 

This  last  equation  shows  that  Tf^fj(p)  reaches  its  minimum  - 1 for  p - 0 and 

p • 1.  This  is  in  agreement  with  the  result  of  Slagle  and  Dixon  [5,  p.  201]  since  it 
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1 

corresponds  to  the  case  when  all  terminal  nodes  are  assigned  the  same  value  and 
therefore  all  oosslble  cut-offs  do  occur.  Equation  (3.1 4)  also  shows  that  admits  a 

maximum  for  p C (0,  1);  although  the  exact  maximum  cannot  be  readily  obtained,  we  will 
derive  a lower  bound  In  the  following.  We  first  establish  a preliminary  result. 

Lemma  3.5: 

The  unique  positive  root,  of  the  equation 

x'^'  * X - 1 - 0 

Is  In  the  Interval  (0,  1).  Asymptotically  (for  large  n)  It  satisfies: 

1 - F_  ~ i In  n . (3.15) 

^ n n 

Proof: 

As  there  Is  no  ambiguity,  we  will  drop  the  Index  n from  in  the  following. 

Let  g(x)  = x'^  * X - 1,  note  that  g(0)  - -1  < 0 and  gll)  = 1 > 0.  Since  gix)  Is 
continuous  and  strictly  Increases  for  x positive,  the  equation  g(x)  = 0 admits  a unique 
positive  root,  f,  which  Is  in  the  Interval  (0,  1). 

We  observe  that  equation  f - 1 ■=  0 can  be  rewritten  as 

1 - r 

J -(l  * I 

from  which  we  deduce  that 

J - r > -i-.  (3.16) 

a ♦ J 


I On  the  other  hand,  since  we  obtain 
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When  p » we  obtain  immedi.alely  that,  for  i - 0,  I,  pj  • Hence 
Pe  • and  . 

From  equations  (3.13)  and  (3.15)  it  follows  that,  for  large  n: 

WV  " Mnn]'',  (3.18) 

while  equation  (3.14)  shows  that 

(3.19) 

Equations  (3.18)  and  (3.19)  Indicate  that  T^^(p)  can  be  largely  Influenced  by  the 
variations  of  the  probability  distribution  for  the  static  values.  This  result  can  be  easily 
generalized  to  In  the  next  section,  we  will  derive  an  approximation  to 

which  corresponds  to  Its  worst  case  behavior. 

4 - Number  of  nodes  explored  by  the  oi-/i  procedure:  continuous  case 

In  this  section,  we  derive  an  approximation  to  N^^(m)  by  considering  the  limit  of 
the  finite  series  of  equation  (3.11)  when  m tends  to  infinity  while  the  discrete  probability 
distribution  3 continuous  probability  distribution.  This 

corresponds  to  the  case  studied  by  Fuller,  Gaschnlg  and  Glllogly  [1]  and  by  Knuth  and 
Moore  [3]  when  the  terminal  nodes  of  a rug  tree  are  all  assigned  distinct  values.  In 
particular,  we  will  reestablish  (with  a much  simpler  formula)  a result  of  [1]. 

4.1  - Notations  and  preliminary  results 

We  first  Introduce  the  sequence  of  functions  {/^}  mapping  the  Interval  [0,  i]  Into 
Itself,  and  defined  recursively  by: 

- * , 

f/x)  - f - (1  - for  i~  1,2 

It  Is  readily  verified  by  induction  on  t that  all  functions  are  strictly  Increasing  on  [0,  1] 
and  satisfy  f^(0)  « 0 and  f^(t)  « 1,  1.  e.,  0 and  1 are  two  fixed  points  of  the  functions  for 
all  n and  i.  The  function  /j  will  be  shown  to  be  related  to  the  quantities  defined  In 
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Section  3.1.  Similarly,  in  relation  to  the  quantities  define  the 

following  functions  on  [0,  f];  for  i - 1,  2,  let 

l-lf.-lMf 


h<‘> 


If  we  define  r^(l)  - n and  j/Ol  - i,  we  observe  that  all  functions  r-  and  are  continuous 
on  [0,  1]  (thev  are  actually  polynomials  in  x),  and  that  is  strictly  increasing  while  is 
strictly  decreasing. 

In  relation  to  the  two  products  Fig  and  TT^,  we  also  introduce,  for  i = 1,  2,  the 
following  functions  on  [0,  1]: 

R^(x}  = r^(x}  X ...  X > 

Sj^(x)  - s j(x)  X ...  X ’ 

where  SjCx;  = L Observe  here,  too,  that  functions  and  are  polynomials,  and  that, 
when  X increases  from  0 to  1,  R^{x)  increases  from  J to  while  S^(x)  decreases  from 

to  J. 

Lastly,  for  A = 0,  1,  ...,  2m*l,  let 
t: k = PQ(h-m-l)  . 


Lemma  4.1 ! 


For  i = t,  2,  ...  and  k = 0,  ...,  2m*I,  we  have: 


(4.1) 

(4.2) 


Proof; 


We  first  show  that  for  i = 0,  1,  ...  and  /c  » 0 2m+}: 

• (4.3) 

Since  /qIi)  ” *■,  It  follows  from  the  definition  of  that  equation  (4.3)  holds  when  i « 0. 
Assume,  for  induction,  that  equation  (4.3)  holds  for  t « h.  Then  by  equation  (3.3) 

. 1 - {J  - [fh<<^k^rr  . 

which  shows  that  equation  (4.3)  also  holds  lor  i - h*l  (from  the  definition  of  //,*/)• 
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Observe  that  r^(z:j^)  - 1 * equation  (4.1)  follows 


from  equations  (4.3)  and  (3.4).  Similarly,  if  we  note  that  $^(x)  can  be  rewritten  as 

. r.)  J - {J  - 
‘ " 1 - U - ’ 

equation  (4.2)  follows  from  equations  (3.2),  (4.3)  and  (3.5). 


4.2  ~ Number  of  bottom  positions  examined  by  the  ec-/S  procedure:  continuous  case 

Let  us  return  to  the  definition  of  the  sequence 
observed  in  Section  3.1  with  the  sequence  the  sequence  is  non-decreasing  and 

defines  a partition  of  the  interval  [0,  1],  i.  e.: 

0 = jTo  s c;  s s s ^ • 

The  norm  of  the  partition  is 

IIT^II  » max{  \ I i k i 2m*l  } - max{  pQ(k)  \ -m  i k i m ] . 

In  the  remainder  of  the  section  we  require  the  following. 

Assumption: 

(Al)  lim  max{  pn(k)  | -m  s ft  S m } « 0.  I 

m.-*oo  “ 

This  assumption  ensures  that  the  norm  of  the  partition  tends  to  0 when  m tends 
to  infinity.  It  also  shows  that,  as  m tends  to  infinity,  the  probability  of  two  terminal 
nodes  being  assigned  the  same  value  vanishes.  This  corresponds  to  the  case  studied  by 
Fuller,  Gaschnig  and  Gitlogly  [1],  and  by  Knuth  and  Moore  [3]. 

With  this  assumption,  we  will  now  see  that  the  finite  series  of  equation  (3.11)  can 
be  replaced  by  an  integral  when  m-*cD.  This  is  established  in  the  following. 

Theorem  4.1 : 

Under  assumption  (Al),  we  have: 

Urn  N„  Jm)  - R'JO.S JO.dt , (4.4) 

m->oo  ^ “ 

where  R'^(x)  is  the  first  derivative  of  R^x). 
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Proof: 

Since  there  Is  no  rlsKs  of  confusion,  we  will  drop,  In  the  following,  the  Index  d from 
the  functions  and  S^. 

It  follows  directly  from  Lemma  ^.1  that  for  /t  - 0,  ...,  2m*l: 

R(i^lf)  “ p^(k-m-i)  , 

S(t^)  - TT^  o-J^k-m-1)  , 

which  shows  that  equation  (3.1 1)  can  be  simply  rewritten  as: 

N^  Jm)  - aW2\  , s(,^)  . 

Let  denote  the  series  defined  In  this  last  equation. 

Recall  that  R(x)  Is  a polynomial.  By  considering  the  Taylor  development  of 
we  obtain  for  k ^ 1,  2m*l: 

R(S)^)  - • 

where  ^ ^k^  ^k-  *^ence: 

lik^2m*l  ^ ^ ^ * 

* Z . ^A^k-^k-l^^ 

ii.ki.2m*t  2 ^ ‘ ' 

Since  R and  S are  polynomials,  the  quantity  |R’Yj:15i'yV2|  Is  bounded  by  some  constant, 
say  M,  for  any  x and  y In  [0,  1].  In  particular,  the  second  sum  In  equation  (4.5)  Is  bounded 
In  module  by  k1.l\T ^J\.[e 2^^. q]  • W.i'jT^II  and  therefore  tends  to  0 when  m -*  m since, 
from  assumption  (Al),  1|T^||  -♦  0. 

As  for  the  first  sum  In  equation  (4.5),  we  observe  that  It  corresponds  to  a Riemann 
sum  for  the  function  R'(x)S(x)  over  the  partition  of  [0,  /].  Therefore  since,  In 
particular,  this  function  Is  continuous  and  since  IIT^il  tends  to  0,  the  sum  tends  to  the 
Integral  of  equation  (4.4).  This  proves  the  theorem.  ■ 

In  the  remainder  of  the  section  we  will  reinterpret  the  limit  of  ^(m)  estabtlshed 
In  Theorem  4.1. 


Let  C be  the  distribution  function  of  some  continuous  probability  density  function  g, 
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and  assume,  to  simplify  the  discussion,  that  C(-l)  « 0 and  C(J)  = J (therefore,  CCxJ  - 0 for 
X i.  -1  and  C(x)  « I for  x i 1).  We  define  a sequence  of  functions  for  m ^ 0,  1,  ...  as 
follows.  For  -m  i k •s.  m,  let  » fc/m.  Function  is  defined  as  the  following  step 
function: 

0 If  * < - 0 , 

m * 

G(xj^)  If  X < Xj^^j  , for  -m  i k s.  m-l  , 

1 if  1 = i r . 

The  sequence  of  functions  {C^}  constitutes  a sequence  of  approximations  to  the 
continuous  function  G.  (It  should  be  noted  that  the  convergence  of  the  sequence  is 
uniform  on  the  interval  [0,  /].)  The  function  corresponds  to  the  cumulative  distribution 
of  the  discrete  probability  distribution  pQ(k)  - G^fz^*.)  - C^(xf^~)  associated  with  the 
points  z^  « k/m,  for  k » -m,  _,  m. 


Using  the  approximation  {P(}(l^^].mi,ki,m  density  function  g,  equation  (3.1 1) 

provides  us  with  an  approximation  to  the  average  number  of  bottom  positions  examined  by 
the  a;-/5  procedure  in  a rug  tree  in  which  the  bottom  values  are  drawn  from  the  continuous 
probability  density  function  g.  When  m becomes  larger,  the  approximation  becomes 
better,  and  (due  to  the  uniform  convergence  of  the  sequence  G^)  it  can  actually  be  shown 
(In  a rather  technical  way)  that  the  limit  of  when  m -*  oi  corresponds  exactly  to 

the  average  number  of  bottom  positions  examined  by  the  oi-fi  procedure  in  the  continuous 
case.  As  a matter  of  fact,  equation  (4.4)  could  be  derived  directly  by  considering  a 
continuous  probability  distribution  rather  than  a discrete  one  In  very  much  the  same  way 
we  derived  equation  (3.11)  in  Section  3.  This  result  is  stated  In  the  following. 


Theorem  4.2: 


Let  fQ(x) 

- z,  and,  for  i - 1,  2,  ...,  define: 

f^(x)  - 

1 - {1  - , 

r;(x)  - 

fi(x) 

S^iX/  * 
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R^(-x)  - ri(x)  X X > 

S^(z>  - si(x)  X ...  X i\i/2\M  . 

The  average  number,  of  terminal  nodes  examined  by  the  a-/3  pruning  algorithm  in 

a rug  tree  of  degree  n and  depth  d for  which  the  bottom  values  are  drawn  from  a 
continuous  distribution  Is  given  by; 

^n.d  - * -^0  Rj(t).S/t).dt . (4.6) 

It  Is  to  be  fiOted  that,  unlike  the  case  of  a discrete  probabitity  distribution,  when 
the  bottom  values  are  drawn  from  a continuous  distribution,  the  number  of  terminal 
positions  examined  by  the  ix-/3  procedure  does  not  depend  on  the  distribution  function. 

4.3  - Discrete  case  versus  continuous  case 

Since  equation  (4.6)  has  been  derived  as  the  limit  of  equation  (3.11),  it  Is  reasonable 
to  Investigate  the  validity  of  the  approximation  of  by  As  was  seen  In 

Section  3.3,  strongly  depends  on  the  probability  distribution  {Po(^'^}-msfcsfn 

therefore,  we  cannot  expect  to  be  a close  approximation  of  in  all  cases.  Wo 

will  see  below,  however,  that  ^ provides  us  with  a good  insight  into  the  behavior  of 
the  CX-/S  pruning  algorithm.  Namely,  we  will  see  that  it  constitutes  the  worst  case  of 
over  all  discrete  probability  distributions. 

Since  obtained  as  the  limit  of  N^^(m),  it  is  sufficient  to  show  that,  for  all 

probability  distributions  have: 

In  order  to  prove  inequality  (4.7),  it  is  convenient  to  give  a geometric  interpretation  of 
both  and 

Consider  the  curve  (£,)  defined  by  the  Cartesian  coordinates  (x,  y)  through  the 
parametric  equations 

(a:  [ X - R^(t)  , y - S^(t)  ] , 


A 
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where  the  parameter  £ varies  in  the  interval  [0,  i].  The  integral  of  equation  (4.6) 
represents  the  area  delimited  by  the  curve  (£),  the  *-axis  and  the  parallels  to  the  y-axis 
at  the  abscissas  R^(0)  • / and  (see  Figure  4.1).  Since  Rj(0)  - 1 and 

S^(0)  - the  term  of  equation  (4.6)  can  be  accounted  for  by  the  area  of  the 

rectangle  delimited  by  the  a:-axis,  the  y-axis  and  the  lines  * • f and  y - (the  latter 

line  extends  the  curve  (£.)  in  a continuous  way).  Figure  4.1  represents  the  curve  (£,)  and 
its  extension  in  the  case  n - 3,  d • 6.  The  area  below  the  unbroken  lines  represents  the 
quantity 


S^(t) 


The  sum  of  equation  (3.1 1)  can  also  be  represented  along  with  the  curve  (<C).  It 
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follows  directly  from  the  relations  of  equations  (4.1)  and  (4.2)  that  the  terms  of  the  sum 
represent  the  areas  of  the  rectangles  delimited  by  the  lines  x - * - R(e^),  y - 0 

and  y = R(Sj^),  for  k m 1,2,  ...,  2m-l.  The  quantity  represents  therefore  the  area 

of  Figure  4.1  shown  below  the  broken  lines. 

Inequality  (4.7),  then,  follows  directly  from  the  fact  that,  when  t increases  in  [0,  /], 
R(t)  increases  while  S(t)  decreases. 

5 - On  the  branching  factor  of  the  u-fi  pruning  algorithm 

We  have  deliberately  chosen'to  introduce  first  the  case  when  the  bottom  values  of  a 
game  tree  are  drawn  from  a discrete  probability  distribution  since  it  is  of  most  interest  in 
actual  applications.  The  case  of  a continuous  distribution,  however,  lends  itself  to  an 
easier  analysis,  and,  since  it  constitutes  the  worst  case  over  all  discrete  probability 
distributions,  we  will,  in  this  section,  examine  the  integral  of  equation  (4.6)  rather  than 
the  series  of  equation  (3.1 1). 


5.1  - Prorious  results 

In  Section  1,  we  introduced  the  branching  factor  as  a cost  measure  for  the  work 
involved  in  searching  a tree.  Rather  than  considering  the  number,  of  terminal 

positions  examined  by  a search  algorithm,  as  a measure  of  performance  of  the  algorithm, 
we  could  have  considered  the  total  number,  of  nodes  (terminal  and  internal)  explored 
during  the  search.  In  the  case  of  the  £x-/5  pruning  algorithm,  since  given  by 

equation  (4.6),  does  not  depend  on  the  distribution  function  of  the  bottom  values,  we 
deduce  that  ^ satisfies: 

Since  it  can  be  checked  easily  that  0 i -.j  s we  obtain  d ^ d ^ d' 


therefore: 
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Thus  Definition  1.1  provides  us  with  a measure  of  performance  useful  to  compare  search 
algorithms.  In  the  following,  we  review  some  of  the  results  which  have  already  been 
presented  in  the  literature. 

Minimex  search 

The  minimax  search  examines  systematically  all  nodes  of  a tree.  It,  therefore, 
examines  d “ terminal  nodes  in  a uniform  tree  of  degree  n and  depth  d,  leading  to  a 
branching  factor 

mtrum&x 

cc-fi  procedure  under  optimal  ordering 

Slagle  and  Dixon  [5,  p.  201]  have  shown  that,  when  all  possible  a-  and  /S-cut-offs 
occur,  the  ot-fi  procedure  examines 

N^d  - i 

terminal  positions.  In  this  case,  the  corresponding  branching  factor  is 

procedure  (experimental  results  from  [1]} 

Based  on  a series  of  simulation  results,  Fuller,  Gaschnig  and  Gillogly  [1]  have 
argued  that  the  formula 

- c(d).n0.72d  * 0.277 

constitutes  a reasonable  approximation  to  the  number  of  bottom  positions  examined  by  the 
CX-/3  procedure  for  small  values  of  n and  d,  and  that  1 s c(d)  s 2 (at  least  for  the  range  of 
values  they  considered).  For  comparison  purposes,  let  us  assume  that  their  approximation 
can  be  extrapolated  for  any  n and  d.  Provided  that  c(d)^^‘^  -*  t when  d -*  oo,  we  obtain 

In  view  of  the  results  of  Section  3.3,  we  can  question  the  accuracy  of  the  approximation 
for  large  n since  it  follows  from  Theorem  3.2  that 
t - OfnAnn). 


i 

1 
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oc-  'i  procadure  without  deep  cut-offs 

Knuth  and  Moore  [3]  have  analyzed  a simpler  version  of  the  a-fi  procedure  by  not 
considering  the  possibilities  of  deep  cut-offs.  This  fi-procedare  is  the  same  as  the 
a!-/?  procedure  except  that  no  a-values  are  passed  to  the  a-/3  procedure;  instead,  the 
lower  value  tx  is  always  set  to  -oo  before  exploring  the  successors  of  a node.  Knuth  and 
Moore  have  shown  that  the  branching  factor  of  this  procedure  satisfies 
^^(n)  m Q(n/[r\  n)  . 

Note  that,  since  the  /?-procedure  always  explores  more  nodes  at  any  depth  in  a tree  than 
the  full  procedure  does  in  the  same  tree,  P.^(n)  provides  us  with  an  upper  bound  for 

5.2  - Bounds  on  the  branching  factor  of  the  oi-fl  procedure 

In  this  section  we  will  derive  some  lower  and  upper  bounds  on  the  branching  factor 
of  the  a'-/3  pruning  algorithm.  In  particular,  since  the  lower  bound  we  derive  grows  with  n 
as  n/ln  n,  we  will  be  able  to  conclude,  using  the  result  on  the  branching  factor  of  the 
tx-fi  procedure  without  deep  cut-offs  established  by  Knulh  and  Moore  in  [3],  that  the 
branching  factor  of  the  cx-/3  procedure  is  0('nAn  n). 

We  introduced  in  Section  4.1  the  sequence  of  functions  i •=  0,  1,  ...,  from  [0,  I]  to 
itself,  and  we  observed  that  all  functions  share  the  two  fixed  points  0 and  1 

(Independent  of  n).  Another  common  fixed  point,  which  depends  on  n,  was  Introduced  In 
Section  3.3. 

Lemma  5.1 : 

For  a given  n,  all  functions  f^,  for  i >•  0,  1 share  the  common  fixed  point 

1'^  € (0,  1),  the  unique  positive  root  of  the  equation 
r'*  ♦ * - / - 0 . 

Proofs 

For  clarity,  we  will  drop  the  index  n from  in  the  following. 
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Since  [^(x)  - x,  I is  certainly  a fixed  point  of  Sq\  assume,  for  induction,  that 
then  from  the  definition  of  /j  we  have 

rsv  - ^ - I - - f'*  - f , 

which  shows  that  f is  a fixed  point  common  to  all  functions  /^,  i m 0,  I,  ■ 

Since  is  a fixed  point  common  to  all  functions  f-,  i • 0,  1,  ™,  it  is  easy  to  evaluate 
at  this  point  the  functions  and  defined  in  Section  4.1.  For  i • 1,  2,  we  deduce  that: 

• <5-l) 

In  particular,  it  follows  from  Lemma  3.5  that,  for  large  n: 

~ '‘/I'’''-  <5-2) 

Equations  (5.1)  and  (5.2)  will  be  useful  to  obtain  the  desired  bounds  In  the  remainder  of 
the  section. 

The  geometric  representation  of  equation  (4.6),  given  in  Figure  4.1,  maKes  It  easy  to 
derive  bounds  on  the  quantity  j.  They  are  stated  in  the  following. 

Theorem  5.1; 

The  branching  factor  of  the  iv-/J  pruning  algorithm  in  the  search  of  a rug  tree  of 
degree  n satisfies: 

/i/ln  A ~ n/vln  a , (5.3) 

for  A » 2,  3 

Proof; 

Since,  when  £ Increases  in  [0,  f],  R^(t)  increases  while  S^(t}  decreases,  it  follows 
directly  that  for  any  at  in  [0,  1]  we  have  the  following  inequalities; 

R^<ai).SJai)  < < R^(bi>.S^(0)  * [R^(!)  - R^(at)].S^(ai)  . (5.4) 

If  we  choose  ix  - f^,  we  have  R^(at>  - and  S^(at)  - Since 

Rfld)  « aI^‘^/21  and  S^<0)  - inequality  (5.3)  follows  immediately  from  inequality  (5.4) 

and  the  results  of  Lemma  3.5.  I 


As  an  immediate  consequence,  we  oblain  the  following. 


r ^ ^ 
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Theorem  5.2: 

The  branching  (actor  o(  the  <y-/3  pruning  atgorithm  in  the  search  of  a rug  tree  of 
degree  n satisfies,  for  large  n: 

« OfriAn  n)  . 

Proof: 

The  result  comes  directly  from  the  lower  bound  ^ riAn  n of  Theorem  5.1, 

and  from  the  upper  bound  Ap(n)  obtained  for  the  oi-fi  procedure  without  deep  cut-offs, 
which  Knuth  and  Moore  have  shown  to  be  B(nAn  n).  I 

This  results  confirms,  as  was  suggested  by  Knuth  and  Moore  [3,  p.  310],  that  deep 
cut-offs  have  only  a second  order  effect  on  the  behavior  of  the  u-fi  pruning  algorithm.  On  ' 

the  other  hand,  it  shows  that  the  formula  proposed  by  Fuller,  Gaschnig  and  Gillogly  in  [1]  j 

and  mentioned  in  Section  5.1,  if  it  constitutes  a reasonable  approximation  for  small  values  \ 

! 

of  n and  d (the  range  of  values  they  considered  is  n * cf  s 12),  is  certainly  not  adequate  for  j 

' large  values. 

We  note  that  the  bounds  of  Theorem  5.1  were  obtained  without  difficulty  by 
conveniently  choosing  just  one  point,  on  the  curve  (£,)  since  it  was  easy  to  evaluate 
both  and  I'’  Ihe  next  section,  using  a different  approach,  we  will  derive  a 

tighter  upper  bound  for  and  hence  for 

5.3  - Improved  upper  bound 

Since,  for  d = 1,2,  ....  S ^n.,d*i  ^ ^n,d’  '■* 

when  d tends  to  infinity  as  an  even  integer,  this  quantity  tends  to  the  same  limit  when  d 
tends  to  infinity  as  an  odd  integer.  Therefore,  without  loss  of  generality,  we  will  only 
consider,  in  this  section,  the  case  when  d is  an  even  integer.  Let  d « 2h. 

For  X in  [0,  1]  and  for  i « 2,  ...,  we  define  p^ix)  - rJx)s^{x). 
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Lemma  5.2: 

All  functions  p^,  for  i - 1,  2 have  the  same  absolute  maximum,  In  the 

Interval  [0,  f]. 

Proof: 

From  the  definitions  of  r^(x)  and  sj[x)  we  have  for  i - 1,  2, 

and 

- tj[f^.j(x)]. 

Therefore,  for  i 1,2,  we  also  have,  from  the  definition  of  p^(x): 

Pifx)  - pi[f^.i(x)] . 

The  lemma  follows  by  observing  that,  for  i ^ t,  2,  Is  a one-to-one  function  from 

[0,  J]  to  itself.  I 


Lemma  5.2  shows  that.  In  order  to  study  the  maximum  of  p^(x),  when  x € [0,  f],  it  Is 
sufficient  to  study  the  maximum  of  the  polynomial 

p^(z)  . i - (J  , for  X € [0,  1] . 


Observe  that  i particular,  since  It  can  be  checked  easily 

that,  for  n • 2,  3, > ■/n/(J*-/n),  It  follows  that 

> n for  n - 2,  3 (5.5) 

Theorem  5.3 


The  branching  factor  of  the  <x~fi  pruning  algorithm  for  a rug  tree  of  degree  n 
satisfies; 


where  Is  defined  in  Lemma  5.2. 
Proof: 


(5.6) 


From  the  definition  of  obtain  for  h - 2,  3, 

- R2h-2^‘^-''h<’'^  * • 

By  multiplication  by  S2f/t)  it  follows  that 
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Since,  for  t C [0,  i],  all  factors  in  this  equation  are  non-negative,  we  deduce,  using  the 
results  of  Lemma  5.2  and  the  fact  that  s n when  t C [0,  }],  that: 

s M^R2h-2<OS2^-2^t)  * n r-^(t)  . 

Since,  In  addition, 

R'2(t)  S2(t)  » r’i(t)  si(t)  i n r^t) , 

It  follows  that  for  t f [0,  f]  and  h • 1,  2, 

R'2h(0  S2f,(t)  s n [r'i(t)  * * r‘^(t)]  . (5.7) 

Let  be  the  Integral  defined  In  equation  (4.6).  By  integrating  Inequality  (5.7)  over 

[0,  J]  we  see  that  satisfies: 

^n,2h  ^ [Mn-D]  - n(n.-l)  h 

since  rJO)  m I and  r^(i)  = n for  i - 1,  2 This  shows  that 

^n,2h  ^ ■ 

Equation  (5.6)  now  follows  directly  from  Inequality  (5.5).  ■ 

5.4  - Numerical  results 

Table  5.1  summarizes  the  results  of  this  section.  It  presents  the  various  lower  and 
upper  bounds  we  have  derived  for  the  branching  factor  of  the  a-/S  pruning  algorithm  from 
equations  (5.3)  and  (5.6).  Although  we  have  not  been  able  to  give  an  estimate  for  the 
asymptotic  growth  of  we  can  easily  derive  an  upper  bound  for  this  quantity  by 

studying  rug  trees  of  depth  2 since: 

which  shows  that  s 0(n/Ar  n).  The  numerical  results  of  Table  5.1  Indicate  that 
is  a much  better  upper  bound  for  than  for  the  range  of  values  we 


have  considered. 
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lower  bound 

upper  bounds 

n 

from  [3] 

2 

1.618 

1.622 

1.799 

1.884 

3 

2.148 

2.168 

2.538 

2.666 

4 

2.630 

2.678 

3.243 

3.397 

5 

3.080 

3.166 

3.924 

4.095 

6 

3.S06 

3.633 

4.587 

4.767 

7 

3.915 

4.098 

5.235 

5.421 

8 

4.309 

4.549 

5.872 

6.059 

9 

4.692 

4.993 

6.498 

6.684 

10 

5.064 

5.430 

7.116 

7.298 

11 

5.427 

5.862 

7.726 

7.902 

12 

5.782 

6.290 

8.330 

8.498 

13 

6.130 

6.713 

8.927 

9.086 

14 

6.473 

7.133 

9.519 

9.668 

IS 

6.809 

7.549 

10.107 

10.243 

16 

7.141 

7.963 

10.689 

10.813 

17 

7.468 

8.373 

11.268 

11.378 

18 

7.791 

8.782 

11.842 

11.938 

19 

8.110 

9.188 

12.413 

12.494 

20 

8.425 

9.591 

12.980 

13.045 

21 

8.736 

9.993 

13.545 

13.593 

22 

9.045 

10.393 

14.106 

14.137 

23 

9.350 

10.791 

14.665 

14.678 

24 

9.653 

11.188 

15.221 

15.215 

25 

9.952 

11.583 

15.774 

15.748 

26 

10.250 

11.976 

16.325 

16.265 

27 

10.545 

12.369 

16.873 

16.778 

28 

10.838 

12.759 

17.420 

17.288 

29 

11.128 

13.149 

17.964 

17.796 

30 

11.416 

13.537 

18.507 

18.300 

31 

11.703 

13.924 

19.047 

18.802 

32 

11.987 

14.310 

19.586 

Table  5.1  - Bounds  on  the  branching  factor  of  the  a;-/£?  pruning  algorithm 


6 - Conclusions  and  open  problems 

We  have  presented  an  analysis  of  the  performance  of  the  (x-ft  pruning  algorithm  for 
searching  a uniform  tree  of  degree  n and  depth  d when  the  values  assigned  to  the  terminal 
nodes  are  independent  identically  distributed  random  variables.  The  analysis  takes  into 
account  both  shallow  and  deep  cut-offs  and  we  have  also  considered  the  effect  of 
equalities  between  the  values  assigned  to  the  terminal  nodes. 

A simple  formula  was  derived,  in  Section  3,  to  measure  the  number  of  terminal 
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nodes  examined  by  the  at~(i  procedure  when  the  bottom  values  are  drawn  from  a finite 
range  according  to  an  arbitrary  discrete  probability  distribution.  Although  the  formula  can 
be  easily  computed  numerically,  a direct  analysis  is  made  difficult  by  the  presence  of  the 
probability  distribution.  When  only  two  distinct  values  can  be  assigned  to  the  terminal 
nodes,  It  Is  shown  that  the  number  of  terminal  nodes  examined  by  the  a;-/3  procedure  can 
be  at  least  0[(nAn  and,  In  light  of  the  results  of  Section  5,  this  corresponds  to  the 
worst  case  behavior  of  the  algorithm  (over  all  discrete  probability  distributions). 

A formula  was  then  pres'^nted  In  the  form  of  an  integral  to  measure  the  number  of 
terminal  nodes  explored  by  the  (X“/3  procedure  when  the  bottom  values  are  all  distinct.  An 
analysis  of  the  Integral  shows  that  the  branching  factor  of  the  ai-/S  pruning  algorithm  Is 
GCnAn  n),  a result  which  confirms  a claim  by  Knuth  and  Moore  [3]  that  deep  cut-offs  only 
have  a second  order  effect  on  the  behavior  of  the  tx-/3  pruning  algorithm. 

Although  the  assumption  used  In  Sections  4 and  5 when  the  bottom  values  are  all 
distinct  Is  not  realistic  for  most  practical  applications,  the  results  we  have  derived  from  It 
give  us  some  Insight  Into  the  worst  case  behavior  of  the  u-/3  pruning  algorithm  when 
equalities  between  bottom  values  are  possible,  and  they  are  a useful  complement  to  the 
formula  of  Section  3.  Similarly,  the  branching  factor  analyzed  in  Section  5 provides  us 
only  with  an  asymptotic  measure  of  performance  for  the  ex-/?  pruning  algorithm  (i.  e.,  for 
trees  of  large  depth).  As  Indicated  by  the  results  of  Section  3.3,  however,  the  branching 
factor  can  also  be  used  as  a realistic  measure  of  the  worst  case  even  for  small  trees. 

We  have  measured  the  efficiency  of  the  or-/S  pruning  algorithm  by  the  average 
number  of  terminal  nodes  explored  by  the  algorithm.  It  would  be  Interesting  to  also  obtain 
an  estimate  for  the  standard  deviation  of  this  number. 

The  scheme  we  have  considered  for  assigning  values  to  terminal  nodes  of  a uniform 
tree  lent  Itself  easily  to  analysis.  It  Is,  however,  very  simplistic.  Different  schemes  for 
assigning  static  values  have  been  proposed  in  [1],  [3]  and  [4].  Analyses  of  these  schemes 
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would  be  helpful  for  various  applications!  a step  In  this  direction  was  presented  In  [4]  for 
game  trees  of  depth  2 and  3. 
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probability  distribution  tends  to  a continuous  orobability  distribution.  The  branching 
factor  of  the  alpha-beta  pruning  algorithm  is  shown  to  grow  wilh  n as  GCnAo  n),  therefore 
confirming  a claim  by  Knuth  and  Moore  that  deep  cut-offs  only  have  a second  order  effect 
on  the  behavior  of  the  algorithm. 
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